Estimation in nonstationary random 
coefficient autoregressive models 



Istvan Berkes^, Lajos Horvath^ 2 ) and Shiqing Ling( 3 ) 



Abstract 

We investigate the estimation of parameters in the random coefficient autoregressive 
model Xf, = (<p + b^X^-i + e k , where (ip, to 2 , a 2 ) is the parameter of the process, Eb^ = 
to 2 , Ee^ = a 2 . We consider a nonstationary RCA process satisfying E log | ip + 60 1 > 
and show that a 2 cannot be estimated by the quasi-maximum likelihood method. The 
asymptotic normality of the quasi- maximum likelihood estimator for (p>,uj 2 ) is proven 
so the unit root problem does not exist in the random coefficient autoregressive model. 
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1 Introduction 

In this paper we are interested in the random coefficient model (RCA) defined by the equations 

X k = {<p + 6 fc )AVi + e k , -00 < k < 00, (1.1) 

where ip is a real parameter. The RCA process was introduced by Andel (1976) who also 
studied its properties. For a detailed early study we refer to Nicholls and Quinn (1982). 
Throughout this paper we assume that 



{(bk,ek)} are independent, identically distributed random vectors. (1.2) 

W Department of Statistics, Technical University Graz, Steyrergasse 17/IV, A-8010 Graz, Austria. Re- 
search partially supported by OTKA grants T 43037 and K 61052. 

(2) Department of Mathematics, University of Utah, 155 South 1400 East Salt Lake City, UT 84112-0090, 
USA. Research partially supported by NSF grant DMS 0604670 and grant RGC-HKUST 6428/06H. 

( 3 ) Department of Mathematics and Statistics, University of Science and Technology, Clear Water Bay 
Kowloon, Hong Kong. Research partially supported by Hong Kong Research Grants Council 



1 



Let log + x = max{loga;,0}. It follows from Aue et al. (2006) (cf. also Quinn (1980, 1982)) 
that under condition (11.21) and 

E log + |e | < oo and E\og + \ip + fo | < oo, (1.3) 

equation (II. ip has a stationary, nonanticipating (i.e. Xk is measurable with respect to the 
cr-algebra generated by (foj, e$), i < k) if and only if 

- oo < E\og\(p + fo | < 0. (1.4) 

Quinn and Nicholls (1981) started the study of the estimation of the parameter of the process 
in (11.11) . Let = ((p,u 2 ,a 2 ), where 

Eb = 0, Eb 2 = u 2 > 0, (1.5) 

Ee = 0, Ee 2 = ^ > ( L6 ) 

and 

cov(fo , e ) = 0. (1.7) 

Aue et al. (2006) used the quasi-maximum likelihood method to estimate when ( 11. 4ft holds. 
They established the strong consistency as well as the asymptotic normality of the quasi- 
maximum likelihood estimator under minimal conditions. 
In this paper we consider the case when (jl.4p does not hold. We assume 

X k = (if + fo fc )X fe _! + e fc , 1 < k < n (1.8) 

and 

E log \cp + fo | > 0, (1.9) 

i.e. we start the recursion in (11. 8p from the initial value Xq and ( II. 9p guarantees that the 
solutions of fll.8p cannot converge. Throughout this paper we assume that X is a constant. 
Following the theory developed for the stationary case, we estimate the parameter 6 of the 
process in (11.81) using the quasi-likelihood method. Assuming that foo and e$ are normally 
distributed, the conditional log-likelihood function (the constant terms are omitted) is given 
by 



1 / 

L n (u) = 2j4(u) with 4(u) = -- ilogixX^ + y) 

k=l ^ 



xX 2 _ x + y 



where u = (s,x,y). We show that 



-L n (u) — > oo 
n 



but 



where 



1 / \ p 

— (L n (u) — L n [0)j — >■ f(s,x) for all u with x > and y > 0, 



/MH I{lo4 + l-^-(^. (1.10) 
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Since /(•) does not depend on y, the quasi-maximum likelihood method cannot be used to 

estimate a 2 . Since \X n \ — —> oo (n — > oo) (cf. Lemma ETT]) . so in ( II. ip b n X n -i dominates e n 
which is the reason why the variance of e$ cannot be estimated by the quasi-likelihood method. 
Hence we are interested in estimating 77 = (</?, u 2 ). Now rj n = rj n (y) = (r)n,i(y),Vn,2(y)) is 
defined by 

maxL n (z,y) = L n (rj n ,y), 

z = (s, x) and the set T satisfies 

T = {(s,x) : < s < s*, x* < x < x*} (I'll) 

with some s* < s*, < x* < x*. We prove the asymptotic consistency of fj n (y) for all y and 
consider the asymptotic normality of rj n under various conditions. 

2 Results 

First we study the asymptotic consistency of fj n (y). 
Theorem 2.1. If (O]) . (Oil -Oil and flLTT]) ^oW, tfien 

77„(y)^(^^ 2 ) (2.1) 

for all y > 0. 

Next we consider the asymptotic normality of rj n (y). Let 

fio = I n " I • (2.2) 



-E^o var(6. 




0; 



Theorem 2.2. If the conditions of Theorem \2.1\ are satisfied and 

EeQ < 00 and Eb^ < 00, (2.3) 

i/ien the distribution of n 1 ' 2 ^^ 2 ) — ((p,cu 2 )) converges to the bivariate normal distribution 
with mean and covariance matrix Qq. 

We note that Theorems 12.11 and 12.21 were obtained by Ling and Li (2006) as a preliminary 
result for the study of non-stationary double AR(1) processes when bo and eo are normally 
distributed and independent. Their result implies that in case of normal (b , e ), o~ 2 cannot be 
estimated by the quasi-maximum likelihood method. A similar phenomenon was also observed 
by Jensen and Rahbek (2004a,b) in nonstationary ARCH models. Theorem 12.21 assumes that 
a 2 is known. We show in the next section that r) n {y) is asymptotically normal for all y > 
under the condition Slog \cp + b \ > 0. 



Usually, the statistical inference is about (p, the expected value of the autoregressive coefficient. 
We show that T) n ,i(y) is asymptotically normal for all y so there is no need to know a 2 to get 
asymptotic statistical inference about ip. 
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Theorem 2.3. We assume that the conditions of Theorem \2.1\ are satisfied and (12. 3p holds. 
Then for any y > the distribution of \/n(rj n> \(y) — (p)/ui converges to the standard normal 
distribution and consequently the distribution of \/n(rj nt i{y) — <p)/ yVnMy) converges also to 
the standard normal distribution. 

Next we are interested in the asymptotic distribution of rj n (cr 2 ) — (ip,u 2 ) without assuming 
(I2.3p . The assumption Eb$ < oo will be replaced with the requirement that feg is m the domain 
of attraction of a stable law. This means that 

P{6q > x} = x~ a L(x), where 1 < a < 2 and L is a slowly varying function at oo. (2.4) 
Asumption a > 1 guarantees that Eb^ = uj 2 exists. Let 

a n = ini{x : x~ a L(x) < l/n}. 

If fl2ZD holds, then 

-I $> t 2 -c 2 )^£, (2.5) 

0,1 l<i<n 

where ^ is a stable random variable with characteristic function 

exp{-rf|t| a (l + isign(t) tan(7ra/2))}, if 1 < a < 2, (2.6) 
and d is a positive constant (cf. Breiman (1968, p. 204). 

Theorem 2.4. We assume that the conditions of Theorem \2.1\ are satisfied, C I2.4f) and 

E\eo\ v < oo with some v > 2a/ (a — 1) (2.7) 

hold. Then n l ' 2 {rj n) i{a 2 ) — (p) and n(rj n fl(o- 2 ) — uj 2 )/a n are asymptotically independent, the 
distribution of n l l 2 {rj n ^(o~ 2 ) — cp) converges to the normal distribution with mean and vari- 
ance uj 2 and the distribution of n{rj n 2(o~ 2 ) — u 2 )/a n converges to the stable distribution with 
characteristic function given in (12.61) . 

We note that if {e^} and {bk} are independent sequences, then (12.71) can be replaced with 
Ecq < oo. 

3 Growth of X n 

p 

We will show in Section H] (cf . Lemma 14. ip that under the conditions of Theorem 12.11 X n — > 
oo. Now we find the order of the growth of X n . To state our results we need further notation. 
Let 

& = log|<p + &i|, S(i) = £ 1 -\ h& and 7; = sign (ip + bj). 

l<j<i 

In this section we consider the case when 

Elog\p + b \ > 0. (3.1) 
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Theorem 3.1. If ([O]) . (TOD . (Oj) and ([31]) ao/d, taen 

e - s ^ ln X n ^X + Y a.s. 

where 

l<j<oo 

The random normalization exp(— S(n)) is the correct one in Theorem 13.11 if the limit is non- 
zero with probability one. The next result provide conditions for 

P{Y + X ^0} = 1. (3.2) 

Theorem 3.2. We assume that (Oil . (TOD . (TO]) and (EUD ftota. 

P{(^ + o )X + e = c} = for all c, (3.3) 

i/jen (13. 2p ao/ds. 

and {e^} are independent sequences (3.4) 

and 

P{e = c} < 1 /or a// c, (3.5) 

iaen (13. 2p holds. 

The first corollary says that under condition (13. ip . X n grows exponentially fast with probability 
one. 

Corollary 3.1. If (fO]l . ([L3]) . ffl~8|) flO) and (J33J or ([32]) and ([33]) ao/d, taen 

e -rn|^| >OQ a g j or qII < r < E log \(f + b \ 

and 

e~ Tn \X n \ — >0 a.s. for all r > E\og \ip + b \. 

The second corollary is the asymptotic normality of rj n {y) without assuming that y = a 2 . 

Corollary 3.2. // flL5|) - Oj) . (jUB . fl23j) . (ETB and Q or Q and ([33]) ao/d, 

iaen for all y > i/je distribution o/n 1 / 2 (?7 n (cr 2 ) — (<^,co> 2 )) converges to the bivariate normal 
distribution with mean and covariance matrix f2 . 

Similarly, in case of Elog \ ip + &o| > 0, we have the following generalization of Theorem 12.41 

Corollary 3.3. // flOJ), (H3J -flES) , (HHJ, (Q, H2IZD, dSH) and Q or and (J33]) 

hold, then for all y > 0, n 1//2 (?7 ni i(<7 2 ) — (p) and nirjn^o- 2 ) — uj 2 ) / a n are asymptotically indepen- 
dent, the distribution of n}l 2 {j) n ,i(cr 2 ) — ip) converges to the normal distribution with mean 
and variance uj 2 and the distribution of niffn^ic 2 ) —uj 2 )/a n converges to the stable distribution 
with characteristic function given in (12.61) . 



5 



4 Proofs of Theorems I2.1H2.4 



The proofs will use the following result: 
Lemma 4.1. If (TOD and (TOD-fOP hold, then 

I v I p 
A J > OO, 



(4.1) 



Proof. We note that 

P{e + c(ip + b ) = c} < 1 for all c. 

Indeed, if e + c(y? + b ) = c with probability one, then multiplying this equation with e and 
taking expected values we get Ee\ + cipEe + cEb e = cEe . Since Ee = Ee b = 0, we get 
Eel = °> which contradicts Peg = a 2 > (c.f. (TO]) ). Since ([13]) implies P{</? + b = 0} = 
0, the result follows immediately from Remark 2.8 and Corollary 4.1 of Goldie and Mailer 
(2000). 



□ 



We start with the study of the log likelihood function. 
Lemma 4.2. // (Q]l . (TOD and (0]) -(flU are satisfied, then 

1 



sup 
uer* 



(L n (u) - L n (0)) - f{s, 



x , 



0. 



(4.2) 



where /(•) zs defined in (11.101) and 

T* = {u = (s,x,y) : < s < s*, x* < x < x*, y* < y < y*} : 
with < and < y*. 
Proof. We write 

l„(u)-l„ w =- x; log + - 



(4.3) 



Kk<n 



+ E 



(X fe _i6 fc + e fc ) 2 1 \- ((< / 9-s)X fc _ 1 + X fc _ 1 6 fe + e fc )' 



Using the mean value theorem we conclude 



o E 



log 



, > 2 *" 2 



^fc-i + y 



a 2 u 2 
log — 

X 



< c 2 



to 2 u 2 Xl_ x + a 2 J x*X|_ 1 + y* 
1 



1 



•£*Xj ( ,_ x ~\~ y* 



By f T4TT|) we have that 



1 



(4.4) 
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and therefore by the Markov inequality 



n ^ 



Kk<n 



sup 
uer* 



log 



xX*_ x + y 



0T 



- log — 



X 



0. 



Also, 



E 

Kk<n 



{X k _ x b k + efc) 
uj^Xl, + a 2 



X k-1 



Kk<n 



Kfe<n fe_1 Kk<n K- 1 



+ E 

i< 

E 



(7 



C7 Z 



Similarly to (14.41) we obtain 



a 



Kk<n 



^Xl_ x + a 2 







Since by ( 14. II) and the independence of e n and X n _i we have 

„2 



0. 



thus we get 
Now we write 

E W 

Kfc<n 



A E 



n ^ w 2 X 2 i + a 2 



a; 



u 2 X 2 k . + a 2 ^ 



E(^- 2 )i- E * 



(7 



— fe c^ 2 X 2 i -f- cr 2 



+ E 



Kk<n 



^ 2 (c 2 X 2 _ 1 + a 2 )- 



The weak law of large numbers yields 

A E 



— a; 



Kfc<n 



Using now the independence of b k and X k -i with (14.10 we obtain 



4 E « 



ri — fc cu 2 (cj 2 X 2 . +a 2 



1 \ ^ 

and £- > 



u 2 a 2 



(4.5) 



(4.6) 
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and therefore by the Markov inequality and (14.61) we conclude 



x k-i 



2 u 2 ) ^:: k ~ i „ -^o. 



Kfc<n 



By the independence of (bk, e&) and Xfc_i we get 



Kfc<n 



on account of (14. ip . resulting in 



< - V E\b k e k \E 
n z — ' 



Kk<n 



Xk-i 



UJ 



2 x 2 



k-1 



n 



Xk-l P n 

fce fc ^7T7^ - — ► 0. 



Kfe<n 



Hence we proved that 



n ^ 



Kk<n 



(X k -ib k + e k f 



u*Xl_ x + a 2 



1^0. 



Next we write 

(X k -i(f - s) + X k ~\b k + e k y 



xXi_ x + y 



{(p-s) 



Y 2 

2 ^k-l , ^2 



1 



xX^ + y ' ~ k xXl_ x + y ' -*xXl_ x + y 



X 2 X 
+ 2 (f ~ S ) b ^ v 2 k '^ , + % ~ g ) e ^ y2 fc "L„ + 2bk6k xX 2 



Xk- 



xX^ + y 



Clearly, 



E sup 
uer* 



^ e k b k 



Xk-i 



Kk<n 



xX 2 _ x + y 



< 



Kk<n 



i Xfc_i 
OfcCfc ^ 



£|e 6 | £ 



|*k-l| 



Kfc<n 



i y* 



and since by (14. II) 



the Markov inequality yields 



E 



\*n\ 



sup 
uer* 



- y e k b 



Kfe<n 



"^-1 + 2/ 
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Similar arguments give 



sup 
uer* 



1 1 i Xk-i 
~\<p-s\ ^ e k — 2 



n 



Next we observe that 



sup 
uer* 



E, X k-i 
h *—2 



Kk<n 



Kk<n 



1 



xX Li + y 



o. 



< sup 
uer* x 



< 



1 



E 6 

l<fc<n 

E * 



+ sup 
uer* 



E>< 



Kk<n 



Kk<n 



■ t 



E i<>< 



x xX^_ t + y 
1 



Kk<n 



•^* x k —i y* 



By the law of large numbers we have 



n 

Kk<n 



/, -A 



and the Markov inequality with (14.11) gives 



Similarly, 



Now, 



1 

sup — 

uer* n 



hi 



Kk<n 



X k-1 



< 



0. 



k xXl_ l +y x 
and therefore, arguing as above, we get 



— ~-b 2 



1 

sup — 
uer* n 



< 



E » 



Kfc<n 



X k-1 



x(xXl_ x +y) x 



L) 



k xX 2 _ 1 + y x 



1 



Similarly, 



Thus we proved 



l<fc<n " x 

^1-1 



Kfc<n 



0. 



sup 
uer* 



n 14 — ' V xXr , + y x 

Kk<n v fc_1 y 



sup 
uer* 



I v - ((</? - s)X fc _x + X fe _i6 fe + e fc ) ^ ( y - s) 2 

X X 
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E 

Kk<n 



xX 2 _ x + y 



0. 



The result in Lemma O follows from (jOj) . dS5]),gSD and lO|) . 



(4.9) 
□ 
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Lemma 4.3. If the conditions of Lemma \4.ty are satisfied and rj = (tp.uj 2 ) G T ; then 

i i p 

sup yh n {y)-r)\ — >0 for all $ < y* < y* . 

y*<y<y* 

Proof. It is easy to see that 

f(s,x) < f(rj) for all (s,x) 
and we have equality if and only if (s,x) =17. Since 

max(L n (z, y) - L n {0)) = L n (rj n , y) - L„(0), 

L n (u), u G T* is continuous on T*, it converges uniformly to f(s,x), standard arguments 
provide the result (cf. Pfanzangl (1969)). □ 



Lemma 4.4. If the conditions of Theorem \2.S\ are satisfied, then for all < y we have 



91M - Yl 



bk 



Kk<n 



o P {n^) 



and 



92,n[ (T 



Kk<n 



o P {n l '% 



(4.10) 



(4.11) 



where gi, n {y) and g2,n(y) are the partial derivatives of L n (u) with respect to s and x at 
(<^ 2 ,2/)- 

Proof. Elementary calculations yield 

d£ k (u) (X k -sX k ^)X k ^ 



and 



and therefore 



34 (u) 

dx 



ds xX l-\ + y 

X k-1 ( x k - sXk-ifXl^ 



9i,M = \ 

Kk<n ^ 



xX\_ x + y {xX 2 k _ x + y)< 



b k X\_ x e k X k _x 



(Xk-ibk + e k ) 2 X^_ 1 



92M= D -\{^xt!+y~ 

Kfc<n k fe-l 1 y 



Using the independence of (e k , b k ) and X k ^\ we get 

ZkXk-l x ~~ 

n 



var 



- T 

,1/2 



n l/2 ^2 X 2 + 



X k-1 



Kk<n 
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Similarly, 

-1/2 



var | n 6 fc 

Kfc<n 

var 



u; 2 ^ + y w 2 



l<fc<n 
l<fc<n v yy 

and thus an application of the Markov inequality completes the proof of f)4.10p . 
Write 



uj 2 X 2 _ x + y (u; 2 X 2 _i + y) 2 

X 4 X 2 



"V"2 

, 2 _ ^ ^fc-l | ^fc-l ( 1 

{ : ~ bk \u 2 xi_ l + y y + ^xi_ l + y y {a 



x 2 

-2e k b k X k _i 



2 ' 



(^f-i + y) 
+ (v 

+ (u; 2 X 2 _ 1 + y) 2[y 



J2\ 



a 



One can easily verify 



l<fc<n 

and since y = a 2 is assumed 



(4.12) 



E (s4t? w '-') (4 - 15) 



and therefore (14.111) is proven. □ 
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Lemma 4.5. If the conditions of Lemma \4.S\ are satisfied, then 

p 



SUP \9ij,n{ U ) ~ 9ijW 

uer* 



l<i,j<2, 



where 



92 1 T ( \ 1 
9ll,nW = W1- L ^( U ) = 2^ 



X k-i 



gi2,n( n ) = S21,nU 



a 2 1 



Kfc<n 



«9 2 1 



dsdx n dxds n 



LJu) 



Kfc<n V k ~ l al 



022,n( U J 



<9x 2 n 



Kfe<n 



l2(xX 2 _ 1+ y) 2_ (xX 2 _ 1+ ^ 



and 



1 



# n (u) = -- 



x 



9i2{u) = g 2 i (u) 



(y?- s) 



6-22 (u) 



(</? - s) 2 + w 2 



2x 2 



Proof. It can be proven along the lines of the proof of Lemma 14.21 and therefore the details 
are omitted. □ 

Proof of Theorem \2.Si Combining the central limit theorem for independent identically dis- 
tributed random vectors with Lemma 14.41 we get that 



n 



-1/2 



{ gi , n (a 2 ),g 2 , n (a 2 )) ^ N 2 (0,n,) 



(4.17) 



where 



/1 



Cir 



2w 4 



\2w 4 4w 8 / 

Let || • || denote the maximum norm of vectors. Let V/i(u) = (dh(u)/dui,dh(u)/du2) T ■ 
Applying the mean value theorem to the coordinates of VL n (u, a 2 ), there are random vector 

£n,l and €n,2 such that Un,j ~ V\\ < Win ~ VW, 3 = 1, 2 and 







dL n (r],a 2 



duj 



(4.18) 



Lemma 14.51 and Theorem 12.11 give that for all y > 



1 9L n (£ x ,y) 1 dL n {£ 2 ,y) 

_ V ~ , -V ~ 

n ou\ n 0U2 



a 



(4.19) 
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where 



/ 1 



V 







2cW 



Putting together fl4.17p - fl4.19p we conclude 

Since f2 = f]" 1 ^*^"/, the proof of Theorem 12.21 is complete. 
The proof of Theorem 12.31 uses the following lemma. 

Lemma 4.6. // the conditions of Lemma \4^ are satisfied, then for all y > 



sup 
uer 



Kk<n V k ~ l yJ 



□ 



Proof. Using the expression for gi2,n( u ) in Lemma [4.51 we get that 



912 



•<»> - ~ E 



E 



e k X k-l 



Kk<n 



(y - gpg_i 1 



^E 



K/c<n 



Also, 



Kfe<n v k ~ 1 b ' Kk<n 



E E 



E 



Kfc<n 



The central limit theorem yields 



sup 

x * <x<x* 



~ E * 

Kfc<n 



Op(n- 1/2 ). 



Next we show that 



where 



Since for any x G [a;*, a;*] 



sup \A n (x)\ = Op(l), 



nV2 ^ (xXl ,+yX 

Kk<n V fc ~ 1 i " 



E MX) 2 = ~T2 E( . ^ - Y 



(4.20) 
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the finite dimensional distributions of A n (x) converge to 0. Similarly, for all x,x' G [a?*, a;*] we 
have by the mean value theorem that 



E(A n (x) - A n (x')) 2 = - ^1x1, 



Kk<n 



1 



{xXl_ t + y) 2 {x'Xl^ + yf 



71 l<k<n V \ X *^k-l 

< {x-x') 2 , 



-i + y* 



for all n large enough. By Billingsley (1968, p. 96), the sequence A n (x) is tight, and therefore 
A n (x) converges in C[x*,x*] to 0. Hence the proof of (I4.20p is complete. 
Repeating the arguments leading to (14.201) . we conclude 



sup 



- y - 2 J2 

n x l ^— ' 



+ sup 



(xX 2 ,+y) 2 

The proof of Lemma 14.61 is established now. 
Proof of Theorem \2.3l Similarly to (14.181) we have 



n z — ' 



efcX|_ 1 



Kk<n 



n (xXl, + yf 



□ 







dL n {rj,y) , / dL n (£ j,y) 



diij 



+ V 



) (*7 n (y)-»7), 3 = 1,2, 



where £nj satisfies ||£ nJ - r}\\ < \\rj n (y) - r}\\, j = 1,2. This gives 

Vn,i(y) -<p = - 

where Cij(n) are defined by 



cu(n)-gi tn (y) + c 12 (n)-g 2 . n (y) ) , 
n n 1 



(4.21) 



1 9L n ($ nil ,y) 1 dL n ($ nt2 ,y)\ 1 _ ( 'cn(n) c 12 (n) 
n au\ n 



duo 



c 2 i(n) c 22 (n) 



Using (Q2"|) - (OS|) we get that 

92 Av) = o P (n). 

Now (|4TI9|) gives that c u (n) - 
that 

|c 12 (n)| = \r] 1>n (y) ~ <p\O p (1) + Op^n- 1 ' 2 ). 
By (OTD - p^D we conclude 



(4.22) 
(4.23) 

u; 2 in probability. Applying Lemma 14.61 and (14.191) we get 

(4.24) 



Vn,l(y) ~<P = (-^ + Op(l)) V,n(?/) + [|?n,l(l/) - ¥>|0p(l) + Op(^ 1/2 )]o P (l) 
= (-U 2 + P (1)) + - V|0P(1) + P (^ 1/2 ), 
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which yields 



1 



Vn,i(y) -<f=(l + op(I))- 1 (-uj 2 + o P (l))-g nA (y) + o P {n- 1 ' 2 ) 

\ n 

Now the first part of Theorem 12.31 follows from ( 14. lOj) . 

The second part is an immedaite consequence of the first part Theorem 12. la nd Slutsky's 
lemma. □ 

The proof of Theorem 12.41 is based on the following modification of Lemma 14.41 



Lemma 4.7. If the conditions of Theorem \2.4\ are satisfied, then for all < y we have 



9iM - Yl 



Kk<n 



op[n 



l/2\ 



(4.25) 



and 



UJ 



Kk<n 



op(a n ), 



(4.26) 



where g\, n {y) and g2, n {y) are the partial derivatives of L n (u) with respect to s and x at 
(<P,w 2 ,v)- 

Proof. We follow the proof of Lemma 14.41 Since the proof of (I4.10p required only that Eb^ < 
oo, we have (14.25j) . 

To prove ( 14.261) . we use ( 14.121) . It is assumed that Ee$ < oo and therefore ( 14. 14[) holds. 
Assumption ( 12.41) yields that E\b \ 2r < oo for all < r < a, and therefore condition ( 12. 7ft 
with Holder's inequality gives Ee^b^ < oo. Hence 



E „-V» Y. 



x k-l 



Kk<n 



i" 2 xU + y) 



\ 2 

?e k b k X k _ x J = ^E{e b ) 2 ( " 

/ ' l<fc<n ^ 



u 2 x 2 _ l + yy 



Clearly, (14. 16j) is satisfied. Thus it is enough to show that 



Kk<n 



[uj 2 -b 



X k-l 



'u 2 X 2 _ 1 + y) 2 



—a = °P\ a r, 



(4.27) 



Let 



e k = b\ — uj 2 and z k -i 



' ~ (u 2 X 2 _ 1 + y) 2 of 

It is clear that \z k \ < c\ with some constant c\. Also, according to Lemma [4.11 \z k \ 
probability, as k — > oo, and therefore 

5 k = Ez\ -> (A; -> oo). 



in 



(4.28) 
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Fix n and define 

e* k = e k I{\e k \ < r n a n } and e* k = e* k - Ee* k , 1 < k < n, 

where r n is a numerical sequence (to be chosen later) tending to oo and /{•} denotes the 
indicator function. Let 

A(t) = / x 2 dF(x), 



where F denotes the distribution function of eo- By the classical theory of the domain of 
attraction of stable laws (cf. Feller (1966, pp. 574-577)) we have that 

lim , Ait \ . = c 2 (4.29) 

with some < c 2 < oo. Also, we note that by the definition of a n and the properties of 
regularly varying functions we get that 

nL(a n )/< -»• 1 (n -> oo). (4.30) 

We also need that for any k > there is a constant < C3 < 00 such that 

L(Xx) 



L{x) 



< c 3 A K for all A > 1 and x > 1. (4.31) 



The assertion in (14.311) is an immediate consequence of the monotone equivalence theorems in 
Bingham et al (1987, p. 23). Indeed, there is a non-increasing regularly varying function ip 
such that 

x~ K L(x) 
hm if \ = X ' 

and since ip(\x) < ip(x) for all A > 1 and x > 1, so (14.311) is proven. 
Using the independence of e* k * and we conclude 

E(er^-i) 2 = ^(eD 2 ^Li < EielfEz 2 ^ = A(r n a n )5 k ^ 
and the orthogonality of {e* k *z k _i, k > 1} yields 

" l<k<n ' n l<k<n n l<k<n 

Combining we get that 

varf — Y e l* z k-i) = 0{l)a~ 2 (T n a n ) 2 ~ a L(T n a n ) ^ ^-l 



V n > Kk<n 
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l<k<n 

By (14.281) . if r n — > oo slowly enough, then ^~ a+K J2i<k<n $k-i/n ~^ 0, showing that 



var 



l<fc<n 

Using the definitions of e* k and a n together with (12.41) . (I4.30P and (14.311) . we obtain that 

P{4 tk} = n(l - F{r n a n )) -> (n -> oo). 



l<fc<n 

Next we observe that 



n 
a, 



xdF(x) — > (n — > oo), 
if r n — > oo slowly enough, so using z k — > (A; — > oo) we conclude that 

xdF(x) = o(l)n / xdF(x) = o(a n ). 

Now the proof of (14.271) is complete. □ 
Proof of Theorem \2.4\ Using (14.181) we get 



Vn,i{(? 2 ) -ip = - ( cn(n)-g 1<n (a 2 ) + c 12 (n)-g 2t „(a 2 ) J , (4.32) 
\_ n n J 

and 

??n.2(cr 2 ) - u; 2 = - ( c 2 i(n)-5fi. n (a 2 ) + c 22 (n)-fi'2.n(o" 2 ) ) , (4.33) 
\ n n J 

where are defined in (14.22)) . By Lemma [4 .7\ (14.191) and (I4.22[) we get that 

-(?„> 2 ) - ^) = - E - ^ + °pM- ( 434 ) 
Since (14.231) clearly holds, we also have (14.241) and from (14.261) we obtain that 

Vn,i(o*) ~<P = c n {n)- gi , n (a 2 ) + {\r)n,i ~ <p\O p (1) + Op(n- 1/2 ))0 P (a n /n). 

n 

Hence by (14.191) and (14.251) we have 

n^iVn^o- 2 ) -<p) = n- 1 ' 2 ^6, + o P (l). (4.35) 

l<k<n 
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The convergence in distribution of n l l 2 (jj n ^(a 2 ) — cp) and n{r] n ^{cr 2 ) — uj 2 )/a n now follows 
from (14.341) and (I4.35P ; only the asymptotic independence must be established. Note that 
the vector (J2i<k<^k/ nl ^ 2 ,J2i<k<n(^l ~ uj2 )/ a n) converges in distribution (cf. Section 10.1 in 
Meerschaert and Schemer (2001)). The first coordinate of the limit is normal, the second 
does not contain normal component and therefore the coordinates of the limit distribution are 
independent (Meerschaert and Scheffler (2001, p. 41)). □ 



5 Proofs of Theorem 13.11 and Corollaries I3.1H3.3 

Using (11.81) one can easily verify that 

it i 

x e =j2^ n & + b i) + x o n> + 6 j)> 

i=l j=i+l 3=1 



and therefore 



UffP + bj)) X e = Y,ei(il(<P + bj)) +X (5.1) 

\j=l J i=l \j=l J 



i=i 

Proof of Theorem IJ.il First we note that assumption (II. 3p yields 

\ei\ = 0(e tCl ) a.s. for any c x > 

(cf. Berkes at al (2003)) and therefore by the strong law of large numbers 

e - 5 « = o(e- iC2 ) a.s. for any < c 2 < E\( \. 

Hence Y is absolutely convergent with probability one and the result follows immediately from 
(EH). □ 

The proof of the second part of Theorem 13.21 is based on the following lemma: 
Lemma 5.1. // (Ojl . lOjL (Oj) fl3~H . (13^) and ([33]) hold, then 

P{Y = c} = for any c. 
Proof. First we show that for any sequence a n 

} j P{e~ s( - t ^ i e i ^ a { | -oo < j < oo} = oo a.s. (5.2) 

l<i<oo 
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Since E£ exists, we get P{£o = 0} = 0, so 7* can be only with probability 0. Hence (15. 2p 
holds, if for any sequence b n 

J2 P{ei^bi} = 00. (5.3) 

Ki<oo 



By (13. 4p . we have (15.31) if and only if 

J2 P{eo ^ &i} = ^2(1- P{e = b t }) = 00. 



(5.4) 



Ki<oo 



l<j<oo 



If P{eo = hi] — > 1, then eo must be a constant with probability 1, contradicting (13.51) . 
Using (15.21) we get that for any sequence a n 

52 P{e- S{i) ^e t + a t } = 00, 

Ki<oo 



(5.5) 



and therefore Lemma [5.11 follows from Levy (1931) (cf. also Breiman (1968, p. 51)). □ 
Lemma 5.2. If (|T2j» , ffT31) - fTl~8|) . ([L~TT]) . fl3TH and Q or and ([33]) hold, then 



fji 



m- E ^ 



Kfc<n 



0(1) a.s. 



and 



fl-2, 



E ^«-» 8 : 



Kfc<n 



0(1) a.s. 



(5.6) 



(5.7) 



where gi >n (y) and g2, n (y) ar ^ the partial derivatives of L n (u) with respect to s and x at 
0,^ 2 ,2/)- 

Proof of Lemma \57<\ We return to the decompositions of gi t n(y) and g2, n (y) used in the proof 
of Lemma 14.41 Using Theorem 13.11 and Lemma 15.11 we get that 



E 

Kk<n~ 



< 



2 *Li + y 



E 

Kk<n 



\ e k\ 



\Xk-l\ 



2 *U + y 



UJ 



Kk<n 



< {max (e-^-^lX^iD^^e-^^X^O^e- 25 ^ 1 )^" 1 ! J2 

{ - °° ) l<k<r 

= 0(1) a.s. 



e fe e 



-S(fe-l) 
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since by Berkes et al (2003), J2i<k<n \ e k\ e S( * k ^ is finite with probability one. Similar argu- 
ments give 



E * 



Kk<n 



X k-1 



2 *U + y 



\) < E 

ijj 1 I uj- 

J Kk<n 
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2 *U + y 



(9(1) a.s., 



completing the proof of (15.61) . 

The proof of (15.71) goes along the same lines and hence it is omitted. 



□ 



Proof of Corollary \3.1\ It is an immediate consequence of the strong law of large numbers and 
Theorems 13.11 and 13.21 

□ 

Proof of Corollary \3.£\ The proof of Theorem 12.21 can be repeated; only Lemma 14.41 must be 
replaced with Lemma [5.21 □ 

Proof of Corollary \3.3[ Minor modifications of the proof of Theorem 12.41 are required only. 
Namely, one must use Lemma 15.21 instead of Lemma 14.71 □ 
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